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1. Explain the main stages of DE optimization algorithm. 



Figure 1: Basic Stages of DE 

Initialization 

> All parameter vectors in a population are randomly initialized . 

> Define upper and lower bounds for each parameter: 

Xj L <Xj,i,l <Xj U 

> Randomly select the initial parameter values uniformly on the intervals 

[xi L ,x/ J ] 

> Suggestion to choose random values between high bound and low bound 

Xj,u = xf + rand*(x/ J - xf) 

Mutation 

> Mutation , recombination and selection will be run for each of the NP parameter 
vectors of a population. 

> For a given parameter vector xi,g (called target vector) randomly select three 
vectors x r i,G , x r 2,G and x,3,g such that the indexes i, rl, r2 and r3 are distinct 
integers e {1, 2, . . . ,NP}. 

> Add the weighted difference of the two vectors x V 2 ,g , x r 3,G to the base vector x r i,o . 

Vi,G+l = Xrl.G + F.( Xr2,G ~ X r 3,G ) 

> The mutation factor F is a constant from [0 , 2] which controls the amplification 
of the differential variation ( x r 2,G ~ x r 3,G )■ 

> Vi,G+i is called the mutant vector or donor vector 






Crossover 


> Crossover incorporates successful solutions from the previous generation. 

> The trial vector w,g+i is developed from the elements of the target vector x,,g and 
the elements of the mutant vector Vi,G+i. 



v j ,i g + 1 ^ (randb(j) < CR) or j = Irand 

x jiG * *f (randb(j) > CR ) and j * Irand 


i= 1,2 ,...,NP ;j= 1,2, ...,£>. 


> randb(j) is the j th evaluation of a uniform random number generator with out 


come e [0 , 1]. 

> CR is called “ the crossover rate ” and it is a constant e [0 , 1] which has to be 
determined by the user. 

> Irand is a random integer from [1, 2, ...,D] which ensures that the trial vector 
Ui'G+i gets at least one parameter from v,,g+;. 

Selection 

> The target vector x,,g is compared with the trial vector w,g+i and the one with the 
lowest cost function value is chosen to the next generation 

v _ f u i.c + i , 'f (/(“;, g+i) ^ /(*;,c)) 

x i,G+l ~ S v ' 

I x i,G ’ "otherwise" 

> Mutation, recombination and selection continue until some stopping criterion is 
reached 

2. Why the population size of DE should be > 4? 

Because its required in mutation process For a given parameter vector j <g,g target vector 
select another three vectors 


3. Explain the labels of the following variants of DE: 

> DE/rand/l/bin 

• DE: Differential Evolution 

• rand: Base vector for mutation is chosen randomly 



• 1: one difference vector is used to construct the donor 

• bin: crossover is binomial 

• Vi,G+l = X r l,G + F.( X r 2,G ~ X r 3,G ) 

> DE/rand/2/bin 

• DE: Differential Evolution 

• rand: Base vector for mutation is chosen randomly 

• 2: two difference vectors is used to construct the donor 

• bin: crossover is binomial 

• Vi,G+l = X r l,G + F.( X r 2,G ~ X r 3,G ) + F.( X r 4,G ~ X r 5,G ) 

> DE/best/l/bin 

• DE: Differential Evolution 

• best: The base vector is the vector with the best fitness in the current population. 

• 1: one difference vector is used to construct the donor 

• bin: crossover is binomial 

• Vi,G+l = Xbest.G + F.( X r l,G ~ X r 2,G ) 

> DE/best/2/bin 

• DE: Differential Evolution 

• best: The base vector is the vector with the best fitness in the current population. 

• 2: two difference vectors is used to construct the donor 

• bin: crossover is binomial 

• Vi,G+l = Xbest.G + F.( Xrl.G ~ X r 2,G ) + F.( Xr3.G ~ X r 4,G ) 

4. Explain the mutation process to get the mutant (or donor) vectors, assume the 
mutation factor F= 0.5 and the current population contains the following vectors 
(NP =4): 

xl 



x4_ 


Where: xl=[ll] x2=[2 4] x3= [ 0 -2 ] x4= [ 3 2 ] 





Target vector xi.c = xl = [ 1 1 ] 

Xrl.G =x2 = [2 4] 

Xr2,G = x3 = [ 0 -2 ] 

Xr3,G = x4 = [ 3 2 ] 

Vl,G+l = Xrl.G + F.( Xr2,G ~ Xr3,G ) 

= [2 4] + 0.5 ([0 -2] - [3 2]) = [2 4]+0.5[-3 -4] = [2 4] + [-1.5 -2]= [0.5 2] 

Target vector X2,g = x 2 = [ 2 4 ] 

X,7.g=x1 = [1 1] 

X r2 .G = X3 = [ 0 -2 ] 

X r3 .G = X4 = [ 3 2 ] 

V 2 .G+I = Xrl.G + F.( Xr2.G ~ Xr3.G ) 

= [!!] + 0.5 ([0 -2] - [3 2]) = [1 1]+0.5[-3 -4] = [1 l] + [-1.5 -2]= [-0.5 -1] 


Target vector X 3 ,g = x3 = [ 0 -2 ] 

Xrl.G =X 1 = [ 1 1] 

X r2 ,G =X2 = [2 4] 

X r3 .G =X4=[3 2] 

V3.G+1 = Xrl.G + F.( Xr2.G ~ Xr3,G ) 

= [1 1] + 0.5 ([2 4] - [3 2]) = [1 1] +0.5 [-1 


2] = [1 1] + [-0.5 1]= [0.5 2] 


Target vector X 4 ,g = x 4 = [ 3 2] 

Xrl.G =X 1 = [ 1 1] 

Xr2,G =X2 = [2 4] 

Xr3.G = X3 = [ 0 -2 ] 

V4.G+1 = Xrl.G + F.( Xr2,G ~ Xr3,G ) 

= [1 1] + 0.5 ([2 4] - [0 -2]) = [1 1] +0.5 [2 6] = [1 1] + [1 3]= [2 4] 


5. Explain the crossover process to get the trial vector ui,g+i from the following two 
vectors: 


1 


3 1 

2 


2.6 

-3 


-1 

7 

Vl.G+l - 

5 

0. 5 

0 

-10 


-15 

6 


4 

L-.6J 


-2 


A SSI 

unif< 


ume the random integer value Irand = 6, the crossover rate CR = 0.7 and the 
iform random numbers generator randb is 

randb = [0.8 0.9 0.1 0.9 0.6 0.9 0.2 0.5] 
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6. What are the dimensionality of the optimization problem in Q(4) and Q(5)? 


For Q(4): D =2 
For Q(5): D = 8 

7. Repeat Q(5) with CR = 0.1 and explain how CR values control the change of the 
trial vector values w,g+i than the target vector x,,c . 
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• A small value of CR (0.1) in Q7 leads to most trial vector components being 
chosen from the target vector. 

• Large values of CR (0.7) in Q5 leads to most trial vector components being 
chosen from the mutant vector. 


8. What are the control parameters for the DE algorithm? 


The parameters that control the performance of DE are three : 

(1) The population size NP 

(2) The mutation factor F 

(3) The crossover rate CR 

9. Explain the effects of the control parameters CR and F on the performance of 
DE. 

> The mutation factor F is relevant to the convergence speed as it is responsible 
for the step size that interferes in the formation of the mutant vector. 

• Small values of F will lead to premature convergence 

• F > 1 will try to take large steps, leading to slow convergence. 

• A good initial choice of F is 0.5 and the effective range usually lies in [0.4, 1], 

> The crossover rate CR controls the number of changes in parameters of a 
population member . 

• A small value of CR ('strong' crossover e.g. 0 or 0.1) leads to most changes 
occurring along one dimension or a small subset of dimensions, and this is useful 
for separable functions . 

• Large values of CR (near 1) lead to most components being chosen from the 
mutant vector and this is suitable for non-separable functions . 


